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ABSTRACT 

A Demonstration Project authorized under the Civil 
Service Reform Act of 1978 was developed and implemented at 
the Naval Weapons Center, China Lake and the Naval Ocean 
Systems Center, San Diego. The Project was designed to 
increase the participation of line managers in the personnel 
management function, and to establish a direct link between 
pay and performance evaluation. 

This paper contains a study of managerial opinions and 
attitudes toward the Demonstration Project. Managerial 
survey data, analysis, and conclusions are presented, and a 
cost/effectiveness model is developed based on data obtained 
after two full-year cycles under the Project. 
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I. 



OBJECTIVES OF THE DEMONSTRATION PROJECT 



The Naval Weapons Center at China Lake, California, is 
currently participating in a joint Demonstration Project in 
cooperation with the Naval Ocean Systems Center, San Diego, 
California. The Project was authorized by the Civil Service 
Reform Act of 1978, Title VI of the United States Code of 
Federal Regulations [Ref. 1]. To date, the Project is the 
only one in existence in the Federal Government, as approved 
by the Office of Personnel Management (OPM) under the Act. 
The objective for allowing such an experiment was to 
determine if removal or modification of some of the existing 
regulations affecting Federal civilian employment could faci- 
litate increased efficiency and productivity. 

Under existing Federal regulations, the functions of 
personnel recruitment, selection and promotion, position 
classification, and pay administration are closely controlled 
by detailed rules and procedures administered through 
personnel specialists assigned at each Federal agency. These 
per sonne lists are subject to periodic inspection by OPM 
auditors, and compliance with regulations is strictly 
enforced. Very little latitude is allowed in the application 
of these regulations to the personnel management functions at 
individual agencies. The real needs of line managers for the 
authority and autonomy to supervise their subordinates are 
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often overlooked by these inflexible regulations. This 
situation has fostered the development of a somewhat 
adversarial relationship between managers, who attempt to get 
the job done, and per sonnelists , who must constantly ensure 
that the rules are followed. The end result of this 
situation is counter-productive to increasing efficiency of 
human resources management at Federal activities. In 
recognition of this dilemma, the Act encouraged presentation 
of new ideas designed to minimize the internal conflicts at 
agencies over the personnel management functions which are 
actually the responsibility of line management to accomplish. 

The intent of this Demonstration Project is to increase 
the participation of line managers in the personnel 
management function and to establish a direct link between 
pay and performance evaluation. The rationale for the former 
purpose is to decentralize the personnel management function, 
and to place it more directly in the hands of line managers, 
while the rationale for the latter purpose is to comply with 
the intent of the Act. Thus, the Project would attempt to 
meet the internal needs of the organization while also 
complying with external goals mandated by law. It was not 
known at the inception of the Project whether or not both of 
these ends could be successfully accomplished. The Project 
would be required to "demonstrate" to external evaluations 
new mechanisms for personnel management in order to assess 
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their usefulness and potential for applicability in the 
Federal service. At the same time, the Project must be 
workable and acceptable to the participants who have their 
own internal criteria for judging its success. 

Success of the Project is being measured by external 
evaluators in terms of the impact on recruitment of 
scientists and engineers for the laboratories; retention of 
high performers; responsiveness of personnel management 
processes to the needs of line management; and, the 
relationship between on-the-job performance and performance- 
based rewards. These measurements are considered zo be key 
indicators of productivity and efficiency at Navy 
laboratories . 

This paper does not attempt to evaluate the entire 

Demonstration Project. Rather, this study will focus on 
specific aspects of the Project which have the potential for 
affecting line managers in the performance of their jobs. An 
assessment will be made of the Project from a managerial 
standpoint to determine how successful it has been in meeting 
the needs of managers for participation in, and control over, 
the personnel management functions of position classification 
and performance evaluation. 

A. BACKGROUND 

During the administration of President Carter the Civil 
Service Reform Act was formulated. The Act was passed by the 
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United States Congress on 13 October 1978, to become 
effective in January 1979. The Act was intended to improve 
the productivity, honesty and competency of the Federal 
service. As a result of the Act, the Civil Service 
Commission was abolished and replaced by the Office of 
Personnel Management plus a separate Merit Systems Protection 
Board . 

Another requirement of the Act was the design of new 
performance appraisal systems for all employees which would 
appraise performance on the basis of written standards. 
Employee participation in the development of standards was 
encouraged, and communication of the standards to affected 
employees was required. Good performance was to be rewarded, 
poor performance was to be improved, and continuing poor 
performance was to be dealt with through reassignment, 
demotion or removal of poor performers. Many of the features 
contained in the section on performance appraisal resembled 
the practice of "Management by Objectives", which will be 
discussed later in this Chapter. 

The Merit Pay System was established by the Act, to 
directly tie compensation to performance for senior level 
employees, grades GS-13 through 15, in managerial positions; 
however, this system did not apply to non-m anager ial 
employees, other employees in grades GS-1 through 12, and 
ungraded workers. The performance appraisal systems for 
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excluded employees remained essentially the same as they were 
prior to the Act, where pay increases for satisfactory 
performance were granted on a periodic basis. As an employee 
advanced in tenure, pay was automatically adjusted to a 
higher step at one, two and three year intervals. Unless 
specific, documented action was taken by the supervisor to 
withhold such an increase, the raise in pay was automatically 
granted. Performance evaluation was accomplished only on an 
annual basis, with each employee's performance being assessed 
by the immediate supervisor against a scale of general work 
attributes and personal characteristics which were not 
directly related to the actual job itself. In many cases, no 
discussion of this rating ever took place between the 
supervisor and the employee. 

Provisions of the Act allowed Federal agencies to 
initiate Demonstration Projects to experiment with 
alternative methods of personnel management which would 
incorporate the basic premises of the Act. The Act limited 
the number of such experiments to not more than 10, covering 
no more than 5,000 employees and lasting up to 5 years in 
duration. Provisions to waive certain portions of Federal 
law governing civilian employment in order to facilitate 
implementation of these projects were included. 

At the Naval Weapons Center (NWC) and the Naval Ocean 
Systems Center (NOSC) the determination was reached that 
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existing Federal Civil Service regulations did not allow 
sufficient flexibility to attract and retain the caliber of 
personnel required at Naval laboratories. Existing 
regulations strictly limited the entry level salaries that 
could be offered by recruiters in competition with the 
private sector. Once hired, an engineer or scientist could 
progress in pay and status only up to a specified full 
performance level. To progress beyond that level required 
the assumption of managerial duties. This presented a 
serious dilemma for researchers who were technical experts 
and excelled in their work. They were forced to advance into 
managerial positions even though they may have lacked the 
desire to give up actual research work to do so, or remain 
dead-ended in their jobs. The pay and position 
classification systems in existence prohibited resolution of 
the situation; therefore, these systems became primary 
targets for renovation through the Project. 

The joint proposal would incorporate complete revisions 
to the pay and position classification systems. In order to 
satisfy the intent of the Act, these new systems would be 
meshed with a pay for performance concept. The approach to 
formulate the proposal was to make it a joint effort between 
the Personnel Department Staffs at NWC and NOSC with 
assistance provided by the University of Southern California. 
The proposal was published in the Federal Register on 4 
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December 1979, public hearings were conducted to solicit 
comments, and the final proposal [Ref. 2] was submitted to 
the Office of Personnel Management for approval. OPM 
approval was ultimately obtained to authorize specific 
waivers of those portions of Federal law which would 
interfere with implementation of the Demonstration Project, 
and the Congress was notified of these waivers. 

B. IMPLEMENTATION 

On 14 November 1979 Task Teams were established at NWC 
and NOSC in each of the major areas of focus, the members of 

which included line managers, employee representatives, and 
members of the Personnel Department Staff. Each team 
developed comprehensive plans for implementation in their 
area of concern, and the total effort was coordinated between 
the two laboratories. The Demonstration Project was 
implemented at China Lake and San Diego in July 1980 for an 
initial population consisting of approximately 2,700 
scientific, engineering and senior professional employees at 
both laboratories. Groups of administrative and technical 
specialists, technicians, and clerical employees were added 
to the Project on an incremental basis until the 5,000 
employee limit was approached in September 1982. As each new 
group was added to the Project, they received comprehensive 
training to introduce them to the new procedures and explain 
the rationale behind them. 
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Two designated control laboratories were the Naval Air 
Development Center, Warminister, Pennsylvania, and the Naval 
Surface Weapons Laboratory, Dahlgren, Virginia. These control 
labs would function under existing regulations governing 
Federal personnel management. Data would be collected perio- 
dically at the control laboratories and compared with 
comparable data from China Lake and San Diego in the three 
major areas affected by the Demonstration Project. External 
evaluation was initially performed by the University of 
Southern California to track progress and report significant 
findings. An OPM concracc for external evaluation was later 
awarded to the firm of Coopers and Lybrand, and in September 
1382 the external evaluation function was taken over by OPM. 
Internal Evaluation Teams were also established at China Lake 
and San Diego to monitor the project. 

C. SYSTEM MECHANICS 

Under the Demonstration Project, managers develop annual 
performance plans (Exhibit 1) for each employee participating 
in the Project. These plans contain specific goals and 
objectives to be met as well a the standards for evaluating 
employee performance. Employees are encouraged to participate 
in the development of their own performance plans, and 
discussions take place between supervisors and employees in 
order to ensure that an understanding is reached on the 
content of the plan for each individual employee. A minimum 
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Exhibit 1. Performance Plan 
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of two monitoring sessions must be conducted with each 
employee during the one-year performance evaluation period, 
and a final written assessment is accomplished at the end of 
the year by the immediate supervisor. This final rating is 
reviewed by the second level supervisor, and if the overall 
performance exceeds the "fully successful" level the rating 
is subject to further review and approval by a Departmental 
Performance Review Board (PRB) [Ref. 3]. The PRB has the 
authority to award pay increases commensurate with the degree 
by which overall performance exceeded expected results 
contained in the performance plan. PRB decisions also take 
into consideration adherence to a payout guideline issued by 
top management; however, there is no absolute limit on the 
number and/or amount of pay increases granted. In cases where 
the final rating is "less than fully successful", corrective 
action must be initiated by the immediate supervisor. 

The involvement of line managers in the pay-setting 
process has changed under the Project, and managers now 
participate in making initial pay determinations as well as 
in determining the amount of annual pay increase that is 
warranted in relation to the employee's performance of tasks 
outlined in the performance plan. The former General 
Schedule pay scale has been replaced by a pay scale for the 
Demonstration Project, consisting of broad pay bands 
encompassing several former General Schedule grades into each 
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pay band (Exhibit 2). These broad bands are divided into 
increments, which replace the ten steps found in each General 
Schedule pay grade. 

A new position classification system was designed to 
coincide with the new pay bands included in the Demonstration 
pay scale. This new system incorporates a dual ladder 
concept, which permits advancement to a higher level without 
assumption of supervisory duties. Each classification 
standard for a particular level includes "menu items" based 
on material contained in the traditional OPM classification 
standards for those GS grades encompassed in that level. Ail 
menu items are contained in a computerized program designed 
to prepare position descriptions. This process makes 
possible the preparation of position descriptions by 
reference to a handbook containing the various level 
standards for the major occupational groups: Scientist/ 
Engineer; Administrative Specialist; Technical Specialist; 
and. Technician. The procedure for preparing position 
descriptions has changed from what was previously a rigorous 
writing exercise to a process of "coding" a position 
description based on selection of relevant menu items from a 
computerized list of alternatives (Exhibit 3). This coding 
results in the printing of a personalized description of 
duties, responsibilities, and qualifications required to 
perform them, a "Personal Activities and Capabilities" 
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Exhibit 2. Basic Professional Pay bevels and Classification Levels 



REQUESTED BY 
CODE 



PAC CODING SHEET 



PAC NO.: EMPLOYEE'S NAME: 



SUPERVISORY POSITION 

YES 

NO 



SERIES: TITLE: 

LEVEL : 

FUNCTIONAL CODE 

RESEARCH 

DEVELOPMENT 

TEST 

SPECIALTY AREA CODES 

PRIMARY 

, OTHERS 




Exhibit 3. PAC Coding Sheet 
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statement or PA C. The PAC takes the place of the old 
position description. 

In summary, the level of managerial involvement in the 
personnel management functions of performance evaluation, pay 
and position classification have been affected as a result of 
implementation of the Demonstration Project. This new level 
of managerial participation is a critical factor in the 
operation of the new systems, and the primary vehicle for 
accomplishing the objectives of the Demonstration Project. 
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II. LITERATURE REVIEW 



In order to acquire a greater appreciation for the 
conceptual framework of the Demonstration Project, a review 
of current literature was conducted. The specific focus of 
this review concentrated on the topics of performance 
evaluation and performance-based pay. Only a selected 
portion of the literature which was examined is cited by 
reference in this chapter. Other references not specifically 
cited are contained in the 3ibl.iography, for those readers 
who wish to explore these topics in greater depth. 



A. RELEVANT THEORIES 

The task of evaluating performance of professional 
employees is especially a difficult one. Newman and Hinrichs 
[Ref. 4] point out that professional employees are "the 
gatekeepers of important information, the designers of new 
products and systems, the drivers of productivity." These 
authors see performance evaluation as an essential means of 
providing recognition and demonstrating support for effective 
performance, without which it would be difficult to motivate 
professionals or to attract and retain them. The process of 
performance evaluation for professionals depends to a great 
extent upon the supervisors of these employees. Supervisory 
feedback is crucial to the success of such a process, for the 
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work itself is generally difficult to measure and provides 
only limited feedback. In order to assist supervisors in 
accomplishing the evaluation task, an appraisal system that 
is relevant to the performance which is being evaluated and 
that is workable and acceptable to both supervisors and 
employees is required. 

In 1977, the United States Civil Service Commission 
published a handbook designed to assist managers in the task 
of performance evaluation [Ref. 5]. This handbook listed 
some characteristics of effective performance evaluation 
programs, which included the following: 

- Performance is measured against written standards which 
are communicated to the employee. 

- Instruments for performance appraisal are easy to 
understand 'and use. 

- Employees are notified, preferably orally and in writing, 
of their performance ratings. 

- The process does not attempt to satisfy all purposes of 
evaluation in a single annual discussion, but provides 
other oppor tunities for supervisors and employees to 
discuss and plan performance. 

The handbook also discusses various methods for developing 
performance evaluation standards. In a section on 
"participative methods", the handbook concludes that 
"employee involvement in work planning, and development of 
performance standards and appraisals promotes fairer, more 
objective performance appraisal and results in improved work 
performance and motivation" [Ref. 5], For jobs in which work 
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outputs are difficult to quantify, performance goals may be 
developed jointly between employees and their supervisors. 
This approach is characteristic of the "Management by 
Objectives" (MBO) process [Ref. 6], but MBO does not include 
methods for establishing individual performance standards. 
Nevertheless, MBO techniques are useful for obtaining 
agreement between employees and their supervisors concerning 
the level of contribution expected toward task 
accomplishment. Experience with participative approaches 
suggests that these methods work best when applied to 
managerial and professional jobs. 

Latham and Wexley [Ref. 7] presented the results of a 
case study concerning motivation of Scientific and 
Engineering personnel in an international research and 
development corporation. Their conclusions were in support 
of participative goal-setting, noting that participation 
actually caused higher goals to be set than the manger would 
ordinarily have assigned to employees. More difficult goals 
corresponded positively to increased effort. 

Concer ning the linkage between pay and performance, 
Lawler [Ref. 8] cites four reasons for basing pay on 
performance : 

1. It has potential for motivating effective 
performance ? 

2. Achievement-oriented people tend to be attracted to 
organizations that base rewards on competency; 
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3. High performers expect to be paid more than low 
performers ; 

4. People are more satisfied when they perceive that 
they are paid in proportion to their efforts. 

This author also presents evidence to show that people will 
make a positive contribution to the success of any new 
performance-based pay system if they are allowed to partici- 
pate in the system design. Such participation fosters a cli- 
mate of trust and openness between management and employees. 
The organizational climate can be a crucial factor in deter- 
mining the success or failure of a new pay system. Lawler 
concludes this discussion by expressing concern about the 
prospects for success of the Merit Pay System because it 
forces a radical change from an existing organizational cli- 
mate which is non-evaluative in nature. Lawler warns that we 
cannot depend upon a pay system change to facilitate organi- 
zational change. If people perceive that they may suffer 
under the new pay system, they will resist the change. 

B. ALTERNATE APPROACHES TO PERFORMANCE EVALUATION 

One aspect of the Demonstration Project which can be 
compared to other existing approaches is the performance 
evaluation process. While the Naval Weapons Center and the 
Naval Ocean Systems Center are experimenting with their new 
performance appraisal procedures, the rest of the Navy has 
implemented the Merit Pay System in July, 1980. Like the 
Demonstration Project, the Merit Pay System for performance 
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evaluation begins the process with the defining of goals, 
setting of objectives, writing out these objectives, and 
discussion between the supervisor and the subordinate. An 
annual appraisal is prepared by the immediate supervisor, and 
reviewed by the second level supervisor as well as a Merit 
Pay Review Officer [Ref. 9]. So far the processes are very 
similar . 

The next step in the cycle is the allocation of merit pay 
funds. A pay pool limit is set by the Secretary of the Navy 
based on guidance received from OPM. By a simple 
calculation, the "pot" is divided up between Merit Pay 
members eligible for a pay increase based on the final 
evaluation of their performance for that year. The amount of 
the actual pay raise is not, therefore, strictly a function 
of an individual's performance but is affected by the amount 
of available funds. A recent Merit Pay pool was limited to 
less than 2% of the total Navy managerial payroll. The end 
result of this process is not pay for performance, but rather 
resembles rationing of a limited resource. 

In 1972, another Demonstration Project was developed by a 
team of faculty from the Naval Postgraduate School in 
response to a request from the Office of the Chief of Naval 
Material [Ref. 10]. This project involved the concept of 
"peer ratings", and was targeted for employees at the Naval 
Supply Center (NSC) and the Navy Regional Finance Center 
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(NRFC), San Diego. This project was implemented at NSC and 
NRFC by direction from higher headquarters in Washington, and 
although first-line managers seemed to like it there was 
resistance and lack of support at the higher management 
levels at NSC and NRFC which caused the project to terminate 
after only one year in operation. 

Peer ratings seemed to be well accepted by the employees 
at NSC and NRFC, and although the project itself did not 
operate long enough to generate detailed performance data it 
was successful in concept. It should be noted, however, that 
the levels and types of employees participating in that 
project were different from those participating in the Merit 
Pay System. Their jobs were more precise in nature, 
involving accounting functions, which contributed to greater 
similarity between groups of jobs and greater understanding 
among employees of the work being performed by their co- 
workers. This made the task of judging a co-worker's 
performance quite a bit simpler due to the homogeneous nature 
of the work itself. 

This project at NSC and NRFC provides an example of the 
need for management support to contribute to the continuing 
success of an organizational change. Even though it was 
apparently successful in concept, this project failed due to 
the lack of management support. 
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Looking at the private sector, a type of "Consensus 
Ranking" is currently being used at the Kaiser Aluminum and 
Chemical Corporation [Ref. 11], Called the Objective 
Judgment Quotient (OJQ) , this system leads to a forced 
numerical ranking for a set of employees. Employees are 
compared both to one another, as well as to benchmark 
standards characteristic of their occupational group. The 
intent of the OJQ is to minimize rater bias in a process 
which normally tends to be highly subjective. The OJQ is 
being used on an experimental basis at Kaiser at this time. 

Also at Kaiser, a merit pay pool is established suoject 
to budgetary constraints and prescribed target percentages of 
ratings to be given in each of four performance categories. 
Employees receiving marginal performance ratings are given a 
90-day probationary notice, and could be terminated for 
failure to improve during probation. Goals, objectives, and 
specific performance criteria are developed and discussed 
with employees by their supervisors. Appraisals are 
accomplished every six months, and the length of the total 
rating period may vary between nine and fifteen months based 
on the discretion of the supervisor. This allows the best 
performers to receive pay raises as often as every nine 
months, and marginal performers are required to wait longer. 
Kaizer also offers a comprehensive benefits package for 
senior managers and executives, which includes bonus and 



26 



stock options. The payout for performance-related pay 
increases alone at Kaiser is currently amounting to 8-9% of 



the total payroll. 

In summary, it becomes clear that there are many operable 
variations of performance-based evaluation systems in both 
the public and private sectors. Some key factors that appear 
to contribute to the success or failure of these approaches 
are that the organization rewards performance in an equitable 
manner; that there is a clear relationship between good 
performance and rewards, and the relationship is clearly 
understood by employees; that management supports the 
performance evaluation system and administers it as intended; 
and, that the amount of the financial incentives offered is 
large enough so that employees receiving a pay raise 
recognize that they have in fact been rewarded. 



C. DISCUSSION 

In consideration of relevant conceptual theories and the 
needs of Navy laboratories to attract and retain high quality 
professionals, the proposal for the Demonstration Project was 
formulated. The performance evaluation system was designed 
specifically to appraise the performance of professionals, by 
increasing the requirement for communications and feedback 
between employees and supervisors and requiring discussion of 
performance expectations. Guidelines issued by OFM and the 
CSRA were closely adhered to while making maximum use of the 



27 



flexibility permitted by the Act in order to streamline the 
position classification and pay systems. The intent of 
involving employees in the development of the new systems 
that would ultimately affect them under the Project was to 
foster and enhance an organizational climate that would be 
conducive to accept the changes. 

This approach makes sense in view of the theoretical 
framework previously presented. It is recognized, however, 
that procedures alone cannot enforce or ensure that 
meaningful communication takes place. Likewise, the 
invention of new position classification and pay systems 
cannot ensure that the users of these systems will believe 
that all problems have been solved by the creation of these 
new systems alone. 

The real determining factor that is crucial to the 
success of any organizational change is the climate of the 
organization. One facet of that climate is managerial 
response to planned change. Thus, the examination of 
managerial attitudes and opinions will give us some useful 
insights into assessing the level of acceptance of a planned 
organizational change, a Demonstration Project, and toward 
predicting the likelihood of success for this change based on 
the degree to which it meets the needs of managers and 
facilitates efficient performance of their work. 
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III. 



NATURE 0? THE PROBLEM 



Prior research concerning the Demonstration Project has 
been conducted by a team at the University of Southern 
California, by the firm of Coopers and Lybrand, by the Office 
of Personnel Management (0PM), and by Internal Evaluation 
Teams at both the Naval Weapons Center and the Naval Ocean 
Systems Center. Various studies have been published by the 
evaluators [Refs. 12, 13 and 14]; however, none of these 
studies have focused specifically on the managerial 
population affected by the Project. 0PM officials have 
recently determined that the evaluation effort must include 
data about managerial participation. 

While it is possible to break-out some of the existing 
data in terms of the level and supervisory status of the 
respondents, the overall orientation of this data is toward 
the impact of -the Project on employees. The existing data 
does not examine the Project in detail from a managerial 
perspective. Thus, the need arose to develop a means for 
collecting managerial data in order to produce an evaluation 
of the total Demonstration Project. 

The research problem is further complicated by the lack 
of a true experimental control group. Even though two 
control laboratories were designated by 0PM, these labs no 
longer operate under the same performance evaluation and pay 
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systems that existed prior to the Civil Service Reform Act 
(CSRA) . Since the Demonstration Project was implemented 
immediately after leaving the pre-CSRA systems, the only 
available baseline data is that which was collected about the 
pre-CSRA systems. 

An alternative is to compare managerial baseline data 
with current data. Since it was not known by the evaluators 
at the inception of the Project that a specific area of 
interest would be managerial involvement, very little pre- 
CSRA data is available in terms of the managerial 
perspective. A true experiment is, therefore, not possible. 

The only remaining alternative is to address the problem 
through the means of a survey, which eliminates the need for 
an experimental control group but still affords a way to 
collect and analyze meaningful data [Ref. 15]. 

The research question to be addressed by the survey 
method is to determine the impact of the CSRA Demonstration 
Project on managers at the Naval Weapons Center. Only the 
survey results from China Lake will be presented and analyzed 
in this paper. A total of 3,900 civilians are employed at 
China Lake, of which 475 are managers participating in the 
Project. Other managers are employed at China Lake; however, 
they did not receive the survey because they are not 
participating in the Project. 
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Since the specific area of concern to managers prior to 
the Project was the inflexibility of the total system for 
personnel management with regard to meeting managerial needs, 
the survey must explore this concern in detail. Data about 
managerial time spent on personnel management functions, and 
the by-products of the classification and performance 
evaluation processes (namely the position descriptions and 
performance plans) must be collected for both the prs-CSRA 
and Demonstration Project Systems. Managerial time is 
considered to be a valid indicator of efficiency not in terms 
of increases or decreases in the amounts of time spend on 
management tasks alone, but also in terms of the quality of 
the time spent and its overall contribution to productive 
output. 

In view of the fact that very little pre-CSRA data was 
available from the managerial population specifically 
pertaining to personnel management functions, it became 
necessary to attempt to reconstruct the necessary pre-CSRA 
data based on memory. It is, therefore, recognized that the 
accuracy of the data about the pre-CSRA system will be 
affected. Nevertheless, this data is needed in order to make 
some comparisons between managerial experience under the old 
and new systems. 
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IV. THE RESEARCH METHOD 



In order to answer the research question to determine the 
impact of the Demonstration Project on managers at the Naval 
Weapons Center, an instrument would be needed to collect data 
from managers. Data would be needed about both the pre-CSRA 
systems for position classification, pay, and performance 
evaluation, and the Demonstration Project Systems for the 
same functions in order to test hypotheses. This data would 
need to focus on managerial time spent on these functions and 
the results of their efforts in order to assess and compare 
the efficiency of the old and new systems. 

A. HYPOTHESES 

The first hypothesis to be tested is that managers who 
supervised employees under the old system will find the new 
system to be an improvement. The reason for this assumption 
is that one of the major complaints from managers about the 
pre-CSRA system was that it was not responsive to their 
needs. The new system was deliberately designed to increase 
responsiveness by allowing greater participation in, and 
therefore, control of, system response to better meet the 
needs of line management. 

The second hypothesis is that there will be no difference 
between the major occupational groups of managers in terms of 
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preference for the Demonstration Project. This assumption is 
based on the fact that managers and employees from each major 
occupational group were instrumental in designing the new 
systems for the Project with regard to their respective 
group. This is because separate Task Teams for each of the 
major occupational groups were established to develop the 
implementation plans for those systems that would affect 
them. 

A third hypothesis to be tested is that managers will 
respond that they are able to make other, more productive use 
of their time under the Project than was possible under the 
old system. The basis for this assumption is that the 
streamlining of the classification process would free up more 
of their time which could be spent on more productive 
activities . 

The fourth hypothesis is that the number of PACs 
considered by managers as accurate would be greater than the 
number of position descriptions that were considered accurate 
under the old system. This response would be attributable to 
the relative ease of preparing and obtaining classification 
of PACs versus the problems associated with the 
classification of position descriptions under the old system. 

A fifth hypothesis is that the relative usefulness of 
PACs will be seen as greater than the usefulness of position 
descriptions. This ties into the previous rationale for 
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greater accuracy of PACs as compared to position 
descriptions, and this higher accuracy should lead to 
increased relevance of PACs over position descriptions. 

The final hypothesis is that the new performance 
evaluation system under the Demonstration Project will be 
viewed as more beneficial to managers than the old pre-CSRA 
system. This assumption is based on the direct relationship 
in the new system between mission accomplishment ana the 
planning process in which performance expectations are 
clearly identified in writing and communicated to employees. 

B . SURVEY DEVELOPMENT 

The first step in conducting this research was to design 
a survey instrument to collect managerial data. Formulation 
of a questionnaire began at The Naval Ocean Systems Center, 
San Diego with a group of personnelists. Inputs to the ques- 
tionnaire were obtained from operating personnel office staff 
members based on questions and concerns that were frequently 
raised by line managers. Some personnelists who have given 
briefings on the Demonstration Project provided inputs based 
on questions more frequently asked in these briefings. 

The format and organization of the questionnaire was 
intended to permit collection of data about managerial expe- 
riences under the pre-CSRA system, followed by data about the 
Project, on similar variables. This type of design would 
facilitate the testing of hypotheses regarding the impact of 
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changes experienced by managers under the new system. 
Comparative data would be easier to obtain about the classi- 
fication process than about performance planning and 
evaluation, primarily because of the lack of mechanisms for 
performance planning and monitoring in existence under the 
pre-CSRA system. For this reason, the major source of data 
about performance evaluation would be attitudinal rather than 
quantitative . 

The first draft of the questionnaire was forwarded to NWC 
China Lake to be evaluated by the members of the Internal 
Evaluation Task Team and per sonnelists. After providing 
their inputs, the Task Team members took a pretest of the 
revised questionnaire. 

The approved version of the questionnaire (Appendix A) 
was distributed at China Lake on 10 March 1983 to the total 
population of 475 managers. At the time that the deadline 
for return of questionnaires was reached on 1 April 1983, a 
total of 265 questionnaires had been returned for a 56% 
response rate. Nine questionnaires were received after the 
deadline, making the total response rate 58%; however, these 
late arrivals were not received in time to be included in 
this analysis. 

C. CONTENT ANALYSIS PROCEDURE 

Completed answer sheets for the sample of 265 cases were 
read by an optical scanner and recorded on magnetic tape. 
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Two of the cases were not readable by the scanner, which 
reduced the sample size to 263 cases. A program was 
developed using the Statistical Package for the Social 
Sciences (SPSS) to analyze the data. The Frequencies 
procedure was used to generate tables for each of the survey 
questions. Contingency tables were then produced for the key 
variables to be analyzed in order to test hypotheses, using 
the Crosstabs procedure. Each variable is identified in the 
tables found in Appendix B, and all variables are listed in 
the indices contained at the end of that Appendix. 

Following the SPSS analysis, a cost-effectiveness model 
was developed. The model utilized the criterion of maximum 
effectiveness/cost ratio. The following equations ace 
included in the model: 

Cost = Supervisory Manhours x Supervisory Salary 
Effectiveness = f (variable list) 

The variables selected for use in the effectiveness 
equation were chosen on the basis of their perceived 
contribution to the overall accomplishment of a manager's 
job. The model was used to compare estimated costs and 
effects for the pre-CSRA systems with the costs and effects 
under the Project. Tables 3-1 and 3-2 present the cost and 
effectiveness data, respectively. 



36 



TABLE 3-1 COST DATA 
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MEAN 31.172 



TABLE 3-2 EFFECTIVENESS DATA (GENERATED BY MAUM) 
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V. SURVEY RESULTS AND DISCUSSION 



Appendix B contains the tables produced by computer 
output as a result of an analysis of the survey data, using 
the Statistical Package for the Social Sciences (SPSS). 
Tables which give the frequency distribution on responses to 
each question contained in the questionnaire are presented, 
preceded by seven contingency tables generated to test 
hypotheses. Some highlights of the results are presented in 
this chapter. 

Tables numbered 1 through 4 present demographic data 
about the respondents. Managers classified as scientists and 
engineers comprised 68% of the respondents; administrative 
specialists accounted for 19% of the sample; technical 
specialists comprised 5% of the respondents; and, 9% were 
technicians. The mean salary for all Project supervisory 
personnel was $43,682 per annum. Approximately 69% of the 
respondents were first line supervisors. Eighty percent of 
these managers were in supervisory positions at the time the 
Demonstration Project was implemented for their occupational 
group. The other 20% became supervisors under the new 
system, which in most cases indicates the absence of 
supervisory experience under the old system. Ninety-three 
percent of all Project supervisors have over ten years of 
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The 



Federal service, and 54% have over twenty years, 
demographic data contained in these tables was supplemented 
by information from the personnel database. 

Table 5 indicates that 61% of the supervisors responded 
that they were the usual author of General Schedule position 
descriptions for their subordinates. Forty-eight percent 
reported that they wrote one to three position descriptions 
per year under the old system, while 22% wrote between four 
and ten per year as noted in Table 22. Table 24 illustrates 
that 32% of the managers estimated that up to 10% of all 
position descriptions in their organization were inaccurate, 
and 22% recalled the percentage of inaccurate descriptions to 
be between 11 and 25%. The major reason noted for not 
updating more of these inaccurate descriptions wa that 
accuracy was not considered important under the old system by 
46% of the supervisors (Table 26). Seventy percent recalled 
that they used each position description not more than twice 
per year in Table 27. The major uses noted in Tables 23 
through 31 in order of importance were for performance 
appraisal, required reviews, recruitment, and promotion. 

Table 6 illustrates that 58% of the managers responding 
indicated that they were the usual author of Personal 
Activities and Capability Statements (PACs) written for their 
employees. Tables 35 through 38 show that only a very small 
percentage of PACs took more than three hours to prepare, 
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while the majority took less chan one hour eac h. Ninety- 
three percent of the respondents felt that 10% or less of all 
PACs were inaccurate (Table 50), The major uses for PACs 
illustrated in Tables 52 through 55 in order of importance 
were performance appraisal, required reviews, promotion, 
instructing employees, and recruitment. 

Ninety-one percent of all respondents in Table 58 replied 
that the position classification process is simplified under 
the Demonstration Project. Ninety-one percent also felt that 
the classification process takes less time under the Project 
(Table 59). Sixty-five percent responded that classification 
is better understood under the Project in Table 66. Seventy- 
eight percent of the managers responded that they are able to 
make other more productive uses of their time now (Table 67'. 

Tables 72 and 73 show that a majority of managers spend a 
decreased amount of time preparing PACs to be classified, and 
negotiating about their classification with Personnel 
specialists. Sixty-eight percent felt that they are spending 
more time now on performance planning (Table 74). Perfor- 
mance reviews and monitoring are on the increase according to 
77% in Table 76. Pay decisions, aware recommendations and 
Performance Review Boards use up more time now according to 
64% of the respondents in Table 77. The majority of other 
supervisory functions relating to personnel management are 
reported as unchanged by the Project. 
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Seventy-six percent of the managers responding in Table 
7 9 felt that the overall net change of the Demonstration 
Project is an improvement over the old system. The 
contribution of performance planning to mission 
accomplishment is reported as greater under the Project by 
62% of the respondents in Table 80. Setting of objectives, 
monitoring of performance, and annual performance ratings are 
viewed as beneficial by over 85% of the respondents in Tables 
81, 82 and 83. Fifty-nine percent view the linkage between 
performance evaluation and pay as beneficial (Table 85). 
Communication of performance expectations is up for 62% in 
Table 88, and 66% feel that employees know more about what's 
expected of them now in Table 89. Over 70% responded that 
performance plans help to identify employee training needs,, 
and to deal with performance problems in Tables 96 and 97. 

Table 99 reports that 77% of the managers responded that 
the Demonstration Project is seen as beneficial to their 
overall supervisory performance. Table 100 concludes the 
questionnaire results with 78% of the respondents stating 
their preference for the Project. 

In relation to the specific hypotheses listed in Chapter 
IV, the contingency tables located at the front of Appendix B 
confirm hypotheses one, three, four, and six. These null 
hypotheses are as follows: 
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: Those respondents who were supervisors at the time of 

entry into the Project found the new system to be an 
improvement. 

Managers feel that they are making other, more 
productive use of their time now. 

H4 : PACs are more accurate than position descriptions were 

under the old system. 

Hg : The Project performance evaluation process makes a 

greater contribution to mission accomplishment than 
the old system. 

Hypotheses two and five were disproved by the analysis. 
The following alternate hypotheses were proven: 

^2 A : There is a difference between the level of 
satisfaction with the Demonstration Project for the 

major occupational groups. 

H5^: PACs are not considered to be more useful than 
position descriptions. 

Scientists/Engineers and Administrative Specialists 
reported a higher satisfaction rate with the Project than did 
Technical Specialists and Technicians. I't should be noted 
that there is a high correlation between the two groups 
comprising a majority of the Project participants and the 
higher satisfaction rate. 

Regarding the relative usefulness of PACs, the majority 
of the respondents indicated no improvement over the 
usefulness of position descriptions under the old system. 
This tends to negate the importance of increased accuracy of 
PACs. 

The overall results of the managerial survey have been in 
favor of the Demonstration Project. While some improvements 
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were reported in the total position classification process, 
the end result of that process (PAC) was not found to be any 
more useful than its predecessor; however, the performance 
planning process was viewed as very beneficial in several key 
areas of importance to managers. Mission accomplishment is 
enhanced, communications are increased, and the plans are a 
useful tool for identifying training needs and handling 
employee performance problems. 

Several constructive suggestions were provided by the 
respondents as an addendum to the survey data. Some managers 
recommended that the decision to award a pay raise should be 
made without the constraint of a pay guideline. Others 
question the value of a ■.•/arcing pay raises solely in 
recognition of performance. A need arises for some mechanism 
to protect the equity of salaries for currant employees 
against the higher entry level salaries that are offered to 
new hires. Some suggestions came out in favor of avoiding 
further attempts to regulate the pay system with the addition 
of midpoint constraints. These issues warrant further 
attention by the Task Teams, Steering Committee, and internal 
evaluators. 
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VI. CONCLUSIONS 



This paper has presented a broad overview of the 
conceptual framework for a Demonstration Project. The 
current literature was researched and selected relevant 
theories were presented. Examples of other approaches to the 
practice of performance evaluation were presented and 
described. Through the development, administration, and 
analysis of survey data specific hypotheses were tested and 
attitudinal information was collected about the impact of 
this Project on managers at the Naval Weapons Center. 

In this concluding chapter, the results of this study are 
reviewed so that it may serve as an executive summary for 
readers interested in a recapitulation of the highlights of 
the study. For a complete breakdown of the survey data, 
Appendix B should be examined. 

Much of the current literature presents evidence in 
support of a participative approach to the design, 
development and administration of performance evaluation and 
pay systems. Communication is stressed as an important 
ingredient to the success of such an approach. Equity is 
also considered to be a key variable to the successful 
operation of performance-based pay systems. A high level of 
trust is needed between employees and management in order for 



45 



performance-based rewards and significant changes in pay 
administration to be accepted, A clear relationship between 
performance standards and behavior that is rewarded is 
essential to that acceptance. The use of a participative 
approach, therefore, is not in itself a guarantee of success. 

The survey results from China Lake show that, overall, 
managers prefer the Demonstration Project to the pre-CSRA 
approach to personnel management; however, there are some 
specific areas of concern that evidence the need for further 
attention. Acceptance of the Project is not equal among the 
major occupational groups. Scientist/Engineers and 
Administrative Specialists are more satisfied with the 
Project than are Technical Specialists and Technicians. This 
may be indicative of a need to reexamine the specific 
concerns of those groups which are less satisfied. 

PACs are more accurate than position descriptions but not 
considered to be any more useful. There appears to be very 
little recognition of any relationship between a PAC and a 
performance plan, which contains specific expectations about 
how the job is to be done. Also, PACs are not used any more 
frequently than position descriptions, and the major reasons 
for their use are the same as for PDs with the exception of 
the addition of the use of PACs for instructing employees 
about the work. Line managers are still the usual authors of 
PACs, in the majority of cases, but they now spend less time 
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preparing PACs and getting them classified than under the 
pre-CSRA system. 

While a reduction of managerial time spent on position 
classification is evident, the net change in time spent on 
personnel management functions is not significant due to an 
increase in time spent on performance planning, monitoring 
and review, pay and award decisions. Managers consider the 
increased amount of time spent on setting objectives, 
monitoring performance, and preparing annual performance 
ratings to be beneficial in accomplishing their supervisory 
responsibilities. Performance plans are seen as useful in 
identifying employee training needs and performance problems. 
We may conclude then that a majority of managers consider 
that their time is better spent under the Project in terms of 
productive outputs. 

Finally, the cost-effectiveness model illustrates 
comparisons of data about the investments for managers in 
terms of manhours and salary, and the resulting levels of 
effectiveness in terms of their performance as supervisors 
both before and after the implementation of the Project. 
Again, it must be noted that the only obtainable data in 
terms of manhours and effectiveness pertains to the position 
classification function. This data is not entirely reliable 
based on the fact that it was necessary for respondents to 
recall from memory their experiences under the old system. 
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Nevertheless, it is clear that managers do not find the 
position classification process to be a positive contributor 
to their supervisory performance. Rather, they view it as a 
task that must be done in order to recruit and promote 
employees Time saved in the position classification process 
is primarily useful to managers because they are now able to 
devote that time to more productive activities. 

One final reference that I would like to cite to put the 
results of this study into perspective comes from a very 
recent publication based on studies of some of the more 
successful firms in the United States. Peters and Waterman 
point out that when an organization fails, that failure is 
seldom attributed to a lack of concern for people o the part 
of management [Ref. 16]. The most successful companies, 
however, look to people to increase productivity rather than 
to financial controls or technology. These firms are 
characterized by a tough approach to management, but that 
approach is enforced by shared expectations and peer pressure 
rather than by elaborate control systems. No one particular 
approach to management can guarantee success indefinitely. 
Overreliance on systems and mechanisms alone cannot enhance 
true productivity. 

My reason for ending this study with Peter's and 
Waterman's thoughts about productivity is to reinforce the 
importance of paying attention to people and their needs for 
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recognition. It would be very risky to expect an elaborate 
system such as this Demonstration Project to successfully 
meet those needs. Such a system must be kept flexible in 
order to be responsive to the needs of people, and to 
managers in particular, for it cannot ever become a 
substitute for good judgment about how to supervise people. 
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SAMPLE QUESTIONNAIRE 

DEPARTMENT OF THE NAVY 

NAVAL WEAPONS CENTER 

CHINA LAKE. CALIFORNIA 93SS5 IN REPLY REFER TO 

10 Mar 1983 



MEMORANDUM 



From: Technical Director 

To: Demonstration Project Supervisors and Managers 

Subj: Evaluation of Demonstration Project 

Enel: (1) Questionnaire regarding personnel functions performed by 

supervisors and instruction and answer sheets 

1. A critical portion of the evaluation of the Demonstration Project 
will be an assessment of its impact on supervisors' involvement in 
Dersonnel management functions. As a Demonstration Project Supervisor 
or Manager, you are being asked to help in this assessment effort by 
completing the enclosed questionnaire. Some of the questions ask that 
you estimate times spent on personnel functions prior to the beginning 
of the Demonstration Project in July 1980. Although we realize it is 
very difficult to reconstruct activities that long ago, we would ap- 
preciate your help in making estimates. 

2. Since this questionnaire (enclosure (1)) is being used at both NOSC 
and NWC, some questions will be specific to one or the other Center. 

This will be indicated on the questions. Please disregard those questions 
labeled "NOSC only." 

3. The completed questionnaires will be processed by automated equipment 
which will summarize the answers in statistical form. Your individual 
answers will remain strictly confidential, and they will be combined 
with those of the other respondents. An optical scanning answer sheet 
and intructions are enclosed. Please return the answer sheet, along with 
any written comments, to Code 0902 at your earliest convenience but not 
later than 1 April 1983. 

4. Thank you for your cooperation in this effort. If you would like a 
summary of the results of this questionnaire, please indicate below. 



Instruction Sheet for Answers to Questionnaire 



1. The answer sheet. General Purpose-NCS-Answer Sheet, is the enclosed 
green-colored sheet (one page with two sides). It is a standard, low- 
cost scoring sheet compatible with optical scanning equipment which will 
be used for tallying the responses. 

2. Ignore the left-hand portion of side 1 which starts with "name". 

This section will not be used and should not have any marks placed on 
it. 



3. Start by reading side 2 of the answer sheet which provides marking 
directions. Please use a No. 2 pencil for scoring. 

4. Begin marking your choices from tne questionnaire on side 1 of the 
answer sheet. Start with question 1. For example, if your answer is 
"4" on question 1, mark column "4" on the answer sheet for question 1. 

5. If you want to add any written comments, enclose them on a separate 
sheet of paper. Please do not write comments on the green answer sheet 
as they will interfere with the optical scan tally. 

i 

6. Please return the answer sheet (do not fold it) and any separate 
written comments in a guard mail envelope to Code 0902. Please do not 
return the questionnaire. 

7. If you have any questions, contact Bob Glen (Code 0902) at extension 
3196 or 2434. Thanks for your cooperation and assistance. 
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demo PROJECT SUPERVISORS’ QUESTIONNAIRE. 

This is a one-time data gathering effort. Please consider 
carefully, and answer as to how the systems were or are actua 1 lv 
working, not hew they should have been or should be working. 

See the enclosed instruction sheet for answering this question- 
naire. 

The use of the optical scan answer sheet has resulted in a rather 
lengthy questionnaire; however, pre-testing indicates that 20 min- 
utes should be sufficient time for completing the questionnaire. 
Your responses are critical for valid overall evaluation results. 

1. What is your current classification? 

1. Scientist/Engineer 

2. Administrative . . 

3. Specialist .* . • 

4. Technician 



2. What is your organisational level? 

1. Branch or Unit Head (1) 

2. Division Head or Assoc. Div. Hd (2) 

3. Department Head or Assoc. Dept. Hd*. . . . .(3) 

4. Director, Major Staff Office Head or Above .(4) 

5. Head, Program Office (5) 

3.. Were you a supervisor/manager in July 1980 when NOSC/NWC 
entered into the Demonstration Project? 

1. Yes (1) 

2 . No ( 2 ) 

4. .If yes, were you 

1. At the same organisational level (1) 

2. At a lower organizational level (2) 



Classification experience prior to Demonstration Project: 

5. In the organization which you supervised prior to 
July 1980, were GS position descriptions usually 



drafted or written by: 

1 . Yourscl f . ( 1 ) 

2. A lower level supervisor (2) 

3. A staff assistant (3) 

4. The employee (4) 



( 1 ) 

( 2 ) 

(3) 

(4) 
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In the organization which you supervised prior to July 1980, 
about how many hours did you personally spend in drafting, 
reviewing, discussinq final preparation of or negotiating over a 
typical position description in each of the following categories? 



6. GS-14/1 5 

1 . Less than 4 hours ( 1 ) 

2 . 4-0 hours ( 2 ) 

3 . 9-16 hours ( 3 ) 

4. More than 16 hours (4) 

5. None done at this level (5) 



7. GS-13 

1. Less than 4 hours (I) 

2 . 4-8 hours ( 2 ) 

3 . 9-16 hours ( 2 ) 

4.. More than 16 hours (4) 

5. None done at this level (5) 

8. GS-12 Scientist, Engineer 

1. Less than 4 hours 

2. 4-3 hours 

3. 9-16 hours 

4. More than 16 hours . 

5. None at this level . 

9. G3-12 Technician, Administrative, Specialist 



1 . Less than 4 hours ( 1 ) 

2. 4-8 hours (2) 

3 . 9-16 hours ( 3 ) 

4. More than 16 hours (4) 

5. None at this level (5) 

10. GS-5/11 Engineer, Scientist, Technician, Administrative 

1. Less than 4 hours (1) 

2 . 4-8 hours ( 2 ) 

3 . 9-16 hours ( 3 ) 

4. More than 16 hours (4) 

5. None at this level (5) 

11. Clerical/Secretarial/Assistant (NOSC only) 

1. Less than 4 hours (1) 

2. 4-8 hours (2) 

3 . 9-16 hours ( 3 ) 

4. More than 16 hours (4) 

5. None at this level (5) 



(1) 

( 2 ) 

(3) 

(4) 

( 5 ) 
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After final preparation, about how many working days di 
usually take for final approval/classification of each of 
following: 



12. GS-14/15 

1 . Less than 4 days ( 1 ) 

2 . 4-8 days ( 2 ) 

3. 9-1G days (3) 

4. 17-30 days (4) 

5. More than 30 days (5) 

G. None at this level (0) 



13. GS-13 

1. Less than 4 days (1) 

2 . 4-0 days ( 2 ) 

3 . 9-1G days ( 3 ) 

4 . 17-30 days (4) 

5. More than 30 days (5) 

6. None at this level (G) 

14. G3-12 Scientist, Engineer 

1 . Less than 4 days ( 1 ) 

2. 4-8 days (2) 

3. 9-1 G days (3) 

4. 17-30 days (4) 

5. Mere than 23 days (5) 

G. None at this level (G) 

15. GS-12 Technician, Administrative, Specialist 

1. Less than 4 days (1) 

2 . 4-0 days ( 2 ) 

3 . 9-16 days ( 3 ) 

4 . 17-30 days ( 4 ) 

5. More than 30 days (5) 

G. None at this level (6) 

1G. GS-5/11 Engineer, Scientist, Technician, Administrative 

1 . Less than 4 days ( 1 ) 

2 . 4-0 days ( 2 ) 

3 . 9-1G days ( 3 ) 

4. 17-30 days (4) 

5 . More than 30 days (5) 

G. None at this level (G) 

17. Clerical/Secretarial/Assistant (NOGC only) 

1. Less than 4 days (1) 

2 . 4-0 days ( 2 ) 

3 . 9-16 days ( 3 ) 

4 . 17-30 days ( 4 ) 

5 . More than 30 days ( 5 ) 

G. None at this level (G) 



d it 
the 
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During a one year period, about how many position descriptions of 
each of the following types were prepared in the organization 
which you supervised? (Consider those needed for recruitment, 
reassignment, update for currency, promotion, etc.) 

18. GS-14/15 

1 . None ( 1 ) 

2. 1-3 (2) 

3. 4-10 (3) 

4. 11-20 (4) 

5. 21-40 (5) 

6 . Over 40 ( 6 ) 

19. GS-13 

1 . None ( 1 ) 

2. 1-3 (2) 

3. 4-10 (3) 

4. 11-20 (4) 

5. 21-40 .(5) 

6 . Over 40 . ( 6 ) 

20. GS-12 Scientist, Engineer 

1 . None ( 1 ) 

2. 1-3 (2) 

3. 4-10 (3) 

4. 11-20 (4) 

5. 21-40 (5) 

6. Over 40 ( 6 ) 

21. GS-12 Technician, Administrative, Specialist 

1 . None ( 1 ) 

2. 1-3 (2) 

3. 4-10 (3) 

4. 11-20 (4) 

5. 21-40 (5) 

6. Over 40 (G) 

22. GS-5/11 Engineer, Scientist, Technician, Administrative 

1 . None ( 1 ) 

2. 1-3 (2) 

3. 4-10 (3) 

4. 11-20 (4) 

5. 21-40 (5) 

6 . Over 40 . ( G ) 

23. Clerical/Secretarial/Assistant (NOSC only) 

1 . None ( 1 ) 

2. 1-3 (2) 

3. 4-10 (3) 

4. 11-20 (4) 

5. 21-40 (5) 

6 . Over 40 { 6 ) 
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24. 



Dow many position descriptions in your organization were 

typically out of date or inaccurate? 



1 . None ( 1 ) 

2. 1-10?, (2) 

3. 11-25% (3) 

4. 26-50% (4) 

5. 51-99% (5) 

6. All (6) 

25. Were any inaccuracies primarily: 

1 . Major ( 1 ) 

2 . Minor ( 2 ) 

26. \/hat was the major reason for not updating 
position descriptions: 

1. It took too much time (1) 

2. There was no payoff (2) 

3. Didn't want to jeopardize employee's GS 

rating ( 3 ) 

4. Accuracy of P.D.’s wasn't important enough to 

spend the time and effort updating them. . .(4) 

5. Not appl icable (5) 



27. On the average about how many timer, per year did you 
actually use or refer to an established position 



description in your organization? 

1 . fever ( 1 ) 

2. 1-2 times each (2) 

3. 3-5 times each (3) 

4. More than 5 times each (4) 

28. - 31. What were the major purposes for referring to a PD? 

Use answer sheet items 28-31 to indicate up to four purposes 

1. Performance appraisal (1) 

2. Instructing/Guiding employees (2) 

3. Required reviews (accuracy, currency, 

position management report, maintenance 
review, etc.) (3) 

4. Position management decisions (4) 

5. Manpower planning (5) 

0. Recruitment (preparing and/or requesting 

certificate) ( 6 ) 

7. Refer to when miking assignments (7) 

0. Promotion (Q) 

9. Reassignment (9) 

10. Guideline for writing similar PDs (10) 
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32. In general, how useful were the position descriptions 

to you? 

1 . Very useful ( 1 ) 

2. Moderately useful (2) 

3. Not useful (3) 

4 . Irrelevant (4 ) 

5. Interfered with my job accomplishment . . .(5) 

33. In general, how well informed or involved in position 
description preparation and the classification process were your 
non-supervisory employees? 

1. Little or no involvement/knowledge (1) 

2. Understood what a P.D. is and its primary 

uses ( 2 ) 

3. Thoroughly understood the process (3) 

Demonstration Project Classification Experience 

34. In the organization you now supervise, are Level/Specialty 
Designators (NOSC) or PACs (NWC) usually drafted or written 
by: 

1 . Yourself { 1 ) 

2. A lower level supervisor (2) 

3. A staff assistant (3) 

4. The employee (4) 

About how many hours do you now spend in preparing, discussing 
negotiating over a typical Level/Specialty Designator (NCSC ) or 
PAC (NWC) in each of the following Cc'itegories? 

35. DP— IV 

1. Less than 1 hour (1) 

2 . 1-3 hours ( 2 ) 

3 . 4-8 hours ( 3 ) 

4 . 9-16 hours (4) 

5. Over 16 hours (5) 

6. None at this level (6) 

36. DP-III 

1. Less than 1 hour (1) 

2. 1-3 hours ( 2 ) 

3 . 4-8 hours ( 3 ) 

4. 9-16 hours (4 ) 

5. Over 16 hours (5) 

6. None at this level (6) 
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37. DT, DS, DA, III 

1. Less than 1 hour (I) 

2 . 1-3 hours ( 2 ) 

3 . 4-8 hours ( 3 ) 

4 . 9-16 hours (4 ) 

5. Over 16 hours (5) 

6. None at this level (6) 

38. DP, DT, DG, DA Levels A, I and II 

1. Less than 1 hour (1) 

2 . 1-3 hours ( 2 ) 

3 . 4-8 hours . ( 3 } 

4 . 9-16 hours ( 4 ) 

5. Over 16 hours (5) 

6. None at this level (6) 

39. Clericai/Secrtarial/Assistant (KOSC only) 

1. Less than 1 hour (1) 

2. 1-3 hours ( 2 ) 

3 . 4-8 hours ( 3 ) 

4. 9-16 hours (4 ) 

5. Over 16 hours (5) 

6. Hone at this level (6) 
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After final preparation, about how many working days does it 
usually take for final approval/classification of each of the 
following? 

40. DP-IV 

1 . 1-3 days ( 1 ) 

2 . 4-8 days ( 2 ) 

3 . 9-16 days ( 3 ) 

4. 16-30 days (4 ) 

5. Over 30 days (5) 

6. None at this level (6) 

41. DP-III 

1 . 1-3 days ( 1 ) 

2 . 4-8 days ( 2 } 

3. 9-16 days (3) 

4 . 16-30 days (4 ) 

5. Over 30 days (5) 

6. None at this level (6) 

42. DT, DS, DA III 

1 . 1-3 days . ( 1 ) 

2 . 4-8 days ( 2 ) 

3. 9-16 days (3) 

4. 16-30 days (4) 

5. Over 30 days (5) 

6. None at this level (6) 

43. DP, DTP, DS. DA Levels A, I & II 

1 . 1-3 days . . . ( 1 ) 

2. 4-8 days (2) 

3 . 9-16 days . . . ( 3 ) 

4 . 16-30 days (4 ) 

5. Over 30 days (5) 

6. None at this level (6) 

44. Clerical/Secretarial/Assistant (NOSC only) 

1 . 1-3 days ( 1 ) 

2. 4-8 days (2) 

3 . 9-16 days ( 3 ) 

4 . 16-30 days ( 4 ) 

5. Over 30 days (5) 

6. None at this level (6) 
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Under the Demo, during a one year period, about how many PACs 
(NWC) or Level/Specialty Designators (NOSC) of each of 
the following types are prepared in your organization? {Consider 
those needed for recruitment, reassignment, update for currency, 
promotion, etc. Do not count those prepared for entering 
employees into the Demonstration Project initially. ) 



45. DP IV 

1 . None ( 1 ) 

2. 1-3 (2) 

3. 4-10 (3) 

4. 11-20 (4) 

5. 21-40 (5) 

6. Over 40 (G) 

46. DP III 

1 . None ( 1 ) 

2. 1-3 (2) 

3. 4-13 (3) 

4. 11-20 (4) 

5. 21-40 (5) 

6 . Over 40 ( 6 ) 

47. DT, DS, DA III 

1 . None ( 1 ) 

2. 1-3 (2) 

3. 4-10 (3) 

4. 11-20 (4) 

5. 21-40 (5) 

6. Over 40 (6) 

48. DP, DT, DS, DA Levels A, I & II 

1 . None ( 1 ) 

2. 1-3 (2) 

3. 4-10 (3) 

4. 11-20 (4) 

5. 21-40 (5) 

6. Over 40 (6) 

49. Cleric.nl/Secretarial/Assistant (NOSC only) 

1 . None ( 1 ) 

2. 1-3 (2) 

3. 4-10 (3) 

4. 11-20 (4) 

5. 21-40 (5) 

6. Over 40 (6 ) 
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50. 



About how many Level/Specialty Designators 
PACs (NWC) are inaccurate or out o £ date 



m 



1 



3 

4 

5 

6 



your organization? 

None 

1 - 10 % 

11-25% 

26-50% 

51-99% 

All 



( NOSC ) 



( 1 ) 

(2) 

(3) 

(4) 

(5) 

( 6 ) 



51. Do you use L/SD's (NOSC), PACs (NWC)? 



1. Less often than P.D.'s (1) 

2. About the same as P.D.'s (2) 

3. More often than P.D.'s (3) 



52.- 55. For what purposes? (use answer sheet lines 51-54 



to indicate up to 4 major purposes) 

1. Performance appraisal . (1) 

2. Instructing/guiding employees (2) 

3. Required reviews (accuracy, currency, position, 
management report, maintenance 

review, etc.) (3) 

4. Position management decisions (4) 

5. Manpower planning (5) 

6. Recruitment (preparing and/or requesting 

certificate .(6) 

7. Refer to when making assignments (7) 

3 . Promo cicn ( 8 } 

9. Reassignment (9) 

ID. Guideline for writing similar PDs (10) 

56. In general, how useful are PACs (NWC), L/SD‘s (NOSC) 
to you? 

1. Very useful (1) 

2. Moderately useful (2) 

3 . Not useful ( 3 ) 

4 . Irrelevant ( 4 ) 

5. Interfere with my job accomplishment . . .(5) 



57. In general, how well informed or involved in L/SD 

(NOSC), PACs (NWC) preparation and the classification 
process are your nonsupervisory employees now? 



1. Little or no involvement/kncwledge (1) 

2. Understand what a L/SD (NOSC), PACs (NWC) is and its 

primary uses (2) 

3. Thoroughly understand the process (3) 



61 



Please provide your frank opinions below in light of you 
Demonstration Project experience 







True 


Partially 

True 


Not 

True 


Don ’ t 
Know 


58. 


Classification is simpler & 
more understandable 
than before. 


(1) 


(2) 


(3) 


(4) 


59. 


Classification takes 
significantly less time 
than before. 


(1) 


(2) 


(3) 


(4) 


60. 


Classification paper work is 
significantly decreased in the 
Demo environment. 


(1) 


(2) 


(3) 


(4) 


61. 


Demo classification levels 
are logical and reflect real 

world d i f f e rences in 
di f f icul ty . 


(1) 


(2) 


(3) 


( ** > 


62. 


Classification authority is 
responsibly exercised at 
this Center. 


(1) 


(2) 


(3) 


(4) 


63 . 


Conflicts /classification 
pressures are significantly 
reduced . 


(1) 


(2) 


(3) 


(4) 


64. 


Conflicts/classification 
pressures are eliminated. 


(1) 


(2) 


(3) 


(4) 


65. 


Position management is more 
important than before. 


(1) 


(2) 


(3) 


(4) 


66 . 


Supervisors and employees 
understand Demo classification 
better than the GS 
classification system. (1) 


(2) 


(3) 


(4) 


67. 


Other more productive use 
is made of my time and 
knowledge than under the old 
classification system. 


(1) 


(2) 


(3) 


(4) 


68. 


Relations between supervisors, 
employees, and personnel 
specialists are better than 
before . 


(1) 


(2) 


(3) 


(4) 
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TRUE 


PARTIALLY 

TRUE 


NOT 

TRUE 


DON'T 

KNOW 


My personnel advisors now 










provide more productive 
assistance than before. 


(1) 


(2) 


(3) 


(4) 



In the personnel management areas listed below indicate whether 
you have experienced mcreases/decreases in work under the Demo: 

ABOUT DON'T 

INCREASED SAME DECREASED KNOW 

70. Long range planning, 
manpower needs 
determination, position 





management . 


(1 ) 


(2) 


(3) 


(4) 


71. 


Recruiting, interviewing, 
selecting employees. 


(1) 


\ 2 ) 


(3) 


(4) 


72. 


Classification: preparing, 

reviewing ?ACs or L/SD's 
instead of PDs . 


(1) 


(2) 


(3) 


(4) 


73. 


Classification: negotiation 










with personnel advisers. 


( 1 ) 


(2) 


(3) 


(4) 


74. 


Planning work with./ for my 
employees (including 
development of 
performance plans) 


(15 


(2) 


(3) 


(4) 


75. 


Developing, coaching, on-the- 










job training of my 
ernployoss . 


(1) 


(2) 


(3) 


(4) 


76. 


Reviewing performance, mo- 
nitoring sessions, 
appraising performance, 
providing feedback to 
employees . 


(1) 


(2) 


(3) 


(4) 


77. 


Compensation (e.g., pay out 












decisions, salary management, 










other monetary awards, 
performance review board 
meetings, etc.) 


(1) 


(2) 


(3) 


(4) 
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ABOUT DON'T 

INCREASED SAME DECREASED KNOW 



3. Dealing with employee 
management relations 
matters (retirements, 
removals, discipline, 

Grievances, appeals, 

etc.) (1) (2) (3) (4) 

9. Do you view the net change as an improvement: 

1. Yes (1) 

2 . No ( 2 ) 



'3. The GS/V'Q performance appraisal system provided for "O'* 
jutstanding, "S" satisfactory, and "U" unsatisfactory ratings. No 
performance planning was required. In comparison, do you feel the 
5emo Project performance appraisal system contributes to your 
-.issicn accomplishment? * x 

1. More than the GS/WG system (I) • 

2. About the same .(2) 

3. Less than the GS/WG system .(3) 



’lease describe the parts of the Demo performance appraisal system 



31. 


Setting objectives/ 


Highly 

Beneficial 


r— 1 

tC 

•r- 1 

0 

•H 

U-4 

•t 

w 

1 


-U 

a u 

T 2 

AJ Si -H 

o = u a 
Z H o z 


5 

<5 

t; 

a 


3 

r* 

3 
-5 
cT £ 




performance planning. 


(1) 


(2) 


(3) 


(4) 


(5) 


32. 


Monitoring/review( s ) 


(1) 


(2) 


(3) 


(4) . 


(5) 


33. 


Year-end performance 
appraisal 


(1) 


(2) 


(3) 


(4) 


(5) 


84. 


Rating definitions 


(1) 


(2) 


(3) 


(4) 


(5) 


85. 


Linkage with pay 


(1) 


(2) 


(3) 


(4) 


(5) 


86. 


Management review process (1) 


(2) 


(3) 


(4) 


(5) 



MORE 

37. In general, how much do you (or your 
subordinate supervisors) know about 
the work your employees are actually 
doing compared with what you knew 
under the GS system? (1) 



SAME LESS 



(2) (3) 
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88. How much communication about work, 
expectations between the employees 
and supervisors in your organization 
is there now compared with before 
the Demo Proiect? 



( 1 ) 



(2) 



(3) 



89. In general, how much do you- feel 
employees know about what is 
expected of them new as compared 
to before the Demo Proiect? 



( 1 ) 



( 2 ) 



(3) 



93. (HOSC) Tlie paperwork required • (Form NCSC 12433/1), 
Performance Planning Appraisal* is : 

1. Insufficient for my need . . 

2. About right 

3. Excessive 



(1) 

( 2 ) 



91. (ICWC) The paperwork required (NAVWPNCEN 12430/8) 
Performance Plan— Demonstration Project, and 
( KAVWPHCEN 12430/S) Performance Assessment- 
Demonstration Project is: 



M ^ 





j. • i. i.iy lie 

2 . About richt 












( 2 1 




3. Excessive 












(3) 


Does 


the time you spend on perf 


ormance p 


lanning and 


appraisal 


unde 


r the Demonstration Project 


contribu 


te tc 


your acccmoli 


shment 


cf t 


he following tasks: 
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33 

•H 








£3 


1 


s -h 5 


JO 


a 


> h 


on 

✓ 4. • 


Long range planning. 


(1) 


(2) 


(3) 




(4) 


(5) 


O') 

• 


Determining manpower 
requirements . 


(1) 


(2) 


(3) 




(4) 


(5) 


94 . 


work scheduling. 


(1/ 


(2) 


(3) 




(4) 


(5) 


95. 


Reporting to higher 
level management /sponsors 


(1) 


(2) 


(3) 




(4) 


(5) 


96. 


Identifying training 
















needs for employees. 


’(l) 


(2) 


(3) 




(4) 


(5) 


97. 


Dealing with employee 
problems . 


(i) 


(2) 


(3) 




(4) 


(5) 



O 
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98 . Predicting financial 

requirements (1) (2) (3) (A) (5) 

99. Overall performance of my 
job as a supervisor/ 

manager. (1) (2) (3) (4) (5) 

100. Overall, would you rather work in the Demo environment than 
in the pre-July 1930 personnel management system? 

1. Yes (1) 

2. No (2) 
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APPENDIX B 



COMPUTER DATA TABLES 
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